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ABSTRACT 

A study investigated the instructional effectiveness 
of the Boswell English as a Second Language Program, a phonics-based 
language teaching program using interactive, multisensory (auditory, 
visual, tactile) computer technology. The program is a sequence of 
lessons designed to give non-native speakers an understanding of 
English phonological structure and its relationship to spelling. 
Subjects were 10 adult students of varying language backgrounds and 
skill levels in an intensive English-as-a-Second-Language program, 
and a parallel control group. Both groups were pre- and posttested 
using the Basic English Skills Test (BEST) and a Bosweil-designed 
test of the material covered in the program. The experimental group 
used the system from 2A to A2.5 hours. Test results indicate that the 
Boswell system had a significant impact on students* ability to 
recognize and discriminate phonemes as well as on their spelling 
abilty. However, little correlation was found between time spent 
using the system and improvement on the Boswell aural test. The 
experimental group performrad better on the Boswell written test but 
not on the BEST written examination. Students who used the program 
were generally positive about the system and visibly engaged by it. 
Students had some criticisms of the program and suggestions for its 
improvement . (MSE) 
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BESTCQPUVAILME 



Abstract 



The Boswell System for phonological acquisition was tested to determine if use of 
the system would result in significant improvement in English skills. The system was 
tested on an experimental group of ten adult English as a Second Language students, 
both male and female, of vaiying EngUsh abiHty and first language background. 
There was a parallel control group. Both groups were pre- and post-tested using the 
Basic EngUsh SkiUs Test and a BosweU-designed test of the material specificaUy 
covered in the program. The experimental group used the system from 24 to 42.5 
hours. 

Post-testing showed a significant improvement in the experimental group in terms of 
aural sound discrimination and spelling. Student comments regarding the system 
were in general very positive. 



mXRODUCTION 

The acquisition of a good pronunciation in a second language is considered to be the 
most difficult task in language learning. It is essential for students to learn the sound system 
of EngUsh or they wiU not be understood. A good ^sp of grammar and vocabulary is rendered 
ineffective if poor pronunciation makes speech unintelligible. 

Aural recognition of a soimd and discrimination between sinular sounds is the fcst step 
in acquiring good pronunciation. This is a very difficult task for students whose mother tongue 
doesn't have a particular sound or sound combination. Students must be able to distinguish 
sounds before they are able to produce them. 

One of the major causes of poor pronunciation is interference from spelling. Con- 
versely spelling is adversely affected by poor pronunciation. By pairing the sounds of the 
language with the written word the student is able to "break the code" of EngUsh speUmg by 
determining which soiinds can he represented by a given sequence of letters. 

In a multi-cultural classroom setting, it would be impossible to address adequately the 
specific problems of each linguistic group. Students aU have different areas of dj^c^^ 
pronunciation and leam at a different rates. For these reasons pronunciation is weU served by 
the individual-based computer system 

SYSTEM DESCRIPTION 

The Bosv/eU system is a phonics-based language teaching program based on interactive, 
multi-sensory (auditory, visual, and tactUe) computer technology. 

The BosweU EngUsh as a Second Language Program is a sequence of lessons designed 
to aUow non-native speakers to develop an understanding of the phonetic structure of the 
EngUsh language and of how sound relates to spelling. 

Lessons begin simply and become more complex as more and more phonemes are 
introduced. In each practice exercise, phonemes are heard first in isolation and then within 
words. As the lessons progress, phrases and then sentences are included. Lessons buUd upon 
previous lessons so that the sounds and words of previous lessons are reviewed and reinforced. 

In the first half of the program, the vowels and aU of the single consonant sounds are 
introduced. The mid-point review includes theme-based practice, idioms, and a dialogue. 

Consonant blends and clusters are included in the second half of the program along with 
separate lessons on voiced and unvoiced consonant pairs, and letters which represent more than 
one sound or do not have a sound of thek own. The end of course review includes more 
theme-based practice, idioms, and tongue twisters. 
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Students are encouraged to practice the sounds as they learn them by subvocal repeti- 
tion. They can repeat exercises if they wish to review. 

METHOD 
Apparatus: 

The physical components of the system consist of the unique Boswell keyboard which 
is based on the use of phonemes, accompanying software, and a system for generating voice 
output 

The Boswell keyboard uses 24 keys to aeate the phonemes of Canadian English. Each 
phoneme is produced by pressing one or more keys. Phonemes are joined together into syllables 
and words by entering the phonemes that compromise that syllable or word. The fingers of the 
left hand press the initial consonant or cluster of the syllable, the thumbs of botii hands press 
the vowel, and the fingers of the right hand press the closing consonant or cluster. The 
individual component phonemes are pressed together and released simultaneously, like playing 
a chord on a piano. 

Subjects: 

The Boswell System was tested on a group of adult English as a Second Language 
students at a private language teaching institution in Vancouver, British Columbia, Canada. 
They were all participants in a five-month intensive English course designed to help them 
function and work effectively in the Canadian environment The students, both male and female, 
were all landed immigrants. 

A group of students was chosen on the basis of the length of time they would continue 
to study at the school. This allowed an adequate length of time for the research to be conducted 
Students at the beginner-level were excluded because the reading component of the program 
would have been too difficult for them. 

The twenty students chosen for the study came from a wide variety of language 
backgrounds: Polish, Vietnamese, Farsi, Mandarin, Cantonese, Spanish, and Korean. They 
had been in Canada for from six months to eight and one-quarter years (on average 1.8 years). 
Their level of education ranged from eight years of school to seventeen years, with the majority 
having a high school education. Their previous English training ranged from 1 1 years in public 
school in Hong Kong to none. 

The twenty students were in three classes at different levels: upper-beginner, lower-in- 
termediate, and intermediate (levels determined by school criteria). The students at each level 
were assigned to the experimental and control groups randomly. There were equal numbers of 
students in both groups with approximately the same range of levels. 



Procedure : 



Each of the twenty students chosen was pre-tested using the Basic English Skills Test 
(BEST) from the Center of Applied Linguistics, Washington and a Boswell in-house test 

The BEST Test (Form B) is a standardized test designed to test listening comprehension, 
speaking, reading, and writing skills at a basic level. The test has a written and oral component 
This test was used to determine the students' entry levels in order to ensure that the experimental 
and control groups were balanced in terms of levels. It was also used to determine if use of the 
Boswell System had a significant impact on overall English ability. 

The Boswell In-house Test (Form A) was designed specifically to test the material taught 
in the Boswell System: sound discrimination, spelling, and comprehension of specific vocabu- 
lary items. The test has a written and an aural component 

Both the experimental and the control groups continued with classroom English training. 
The experimental group substituted one hour per day of class tune with one hour of using the 
Boswell System. Apart from this one hour per day the two groups received the same training. 

The students in the experimental group worked on the Boswell System independently 
and at their own speed. They followed v/ritten instructions on tiie computer screen. A 
supervisor was in the room at all times in order to answer student questions and to solve any 
technical problems that might arise. 

The study was conducted over a period of nine weeks. This gave students who attended 
the sessions everyday the opportunity of having 45 hours of Boswell System time. Due to 
absenteeism, tiie actual number of hours of system time ranged from 20.75 to 42.5 hours witii 
an average of 32.4 hours. 

One student in the experimental group dropped out of the school entirely and was 
replaced by another student This latter student had been in tiie intermediate class and had just 
finished his five-month program. Therefore, he was no longer attending classes. Because of 
a more flexible schedule, he was able to spend 11/2-2 hours per day on the system. He was 
able to complete 20.75 hours of system time in only 4 weeks. 

At the end of the nine- week test period the students were post-tested to determine if use 
of tiie Boswell System had had an effect on tiie improvement of tiie experimental group. The 
battery of tests which was administered consisted of tiie BEST Test and tiie Boswell In-house 
Test 

The BEST Test (Form Q was given to measure tiio change in overall English ability 
over tiie test period. The Boswell In-house Test (Form B) was given as a post-test to determine 
any improvement specifically in the material taught in the Boswell System: sound discrimina- 
tion, spelling, and comprehension of specific vocabulary items. 
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RESULTS 



The results of the pre- and post-tests were subjected to statistical analysis to determine 
if there was a significant difference between the experimental and control groups which could 
be attributed to the use of the Boswell System. 

A One-way Analysis of Variance (ANOVA) of the BosweU Aural Test results revealed 
a significant Test x Group interaction (P is less than or equals .005). A Tukey Post-hoc test 
showed a significant difference between scores. This means that, m terms of aural sound 
discrimination and spelling, the group which had used the Boswell system showed a highly 
significant improvement in score compared with the control group (see Figure 1). There was, 
however, no direct correlation between improvement m Boswell Aural test scores and time 
spent using the Boswell system. 

The same statistical analysis (ANOVA) of the scores for the BosweU Written Test and 
tiie BEST Written and Oral Tests showed no significant differences between the two groups. 
On the BosweU Written Test the BosweU group had a mean improvement of 3.2 pomts and the 
control group a mean improvement of 0.8 pomts. The results of the oral component of the 
BEST were a mean 15.9 pomt improvement for the BosweU group and 8.7 pomts for the control 
group. The BEST written section showed a mean improvement of 0.0 pomts for the BosweU 
group and 2 pomts for the control group. Because the differences between the scores of the 
two groups were not found to be significant, it cannot be conclusively shown that these 
differences were not due to experimental error, such as sampUng error, environmental effects, 
or chance. 

DISCUSSION 

The test results indicate that the use of the BosweU System had a significant impact on 
the students' ability to recognize and discriminate phonemes, as weU as on their spelling ability. 
The improvement m speUing can be assumed to be due to improved understanding of the link 
between speUing and pronunciation. As these are essential components of English, the BosweU 
System has been shown to be effective as a component of an EngUsh course. 

The lack of correlation between time spent using the BosweU system and improvement 
on tiie BosweU Aural Test can be attributed to differences in attentiveness, motivation, and 
innate ability between the students. 

Factors affecting the post-test results are fatigue resulting from five months of intensive 
study, lack of attentiveness because of excitement due to the impendmg end of the course, and 
the fact that the post-testing was conducted during a heat wave when the classroom temperature 
was uncomfortably high. 

The students who used the program were generaUy positive about the system and visibly 
engaged by it. In an evaluation of the system at tiie end of die study, all of the ten stiidents in 
the BosweU group said that they had made improvement. AU of them said that their pronun- 



ciation had improved. Eight students said th^t their vocabulary and listening had improved. 
Seven thought that there had been an improvement in spelling. Five said they.'had improved in 
understanding and four in sentences. Two students felt that their grammar had improved. 

In response to whether or not they enjoyeid using the system and liked the lessons, four 
students answered "yes" and six students said "maybe". Six students sdd "yes" when asked if 
they had improved quickly, three said "maybe", and one "no". Nine of ttie ten students felt that 
the Boswell System had been helpful and one student was unsure. • ' 

The students had some criticism of the program and suggestions for its improvement 
Two of the students reported that the keyboard was difficult to remember and that they were 
sometimes confused. Another two students felt that the time they had worked on the system 
was too short Two students mentioned that the slow speed of the punctuation prompts was a 
problem. Three students complained of unclear sound in the final lessons of the program. 

One student found that the Boswell System on top of classes resulted in too much 
information to absorb and that the system time would have been more effective at a later date. 

Some of the students' suggestions for improvement of the program were: on-screen 
diagrams of the points of articulation, varying visuals for, increased interest, a glossary of 
vocabulary items, modelling of sentence intonation, and interactive voice which would allow 
the students to hear their own pronunciation and to compare it to the model. 

Despite the effectiveness of the Boswell system there are a number of problem areas. 
On a technical level, the voice that is heard is not always clear and, particularly in the later 
lessons, is obscured by interference by machine noise. 

There are still a number of programming errors, though a great many have been cleared 
up in the course of this study. There are errors where the voice file does not match the actual 
pronunciation of the word, where the voice file does not match the keying prompt, where the 
voice and the graphics are out of synchronization, and other such problems. These "glitches" 
can be removed by careful scanning of the program for such errors. 

Each lesson begins with the presentation of a phoneme in isolation. Though different 
theories argue for and against the presentation of phonemes in isolation, in the Boswell program 
the presentation of the individual sounds, without the visual cues of the position of the lips and 
mouth, serves little purpose. The sounds in isolation are difficult to distmguish, even for a 
native speaker. They are often distorted by interference fi:om Cpmputer noise. The sounds are 
much clearer and easier to differentiate in the context of words and minimal pairs. 

When the phonemes of a particular syllable are keyed in correctiy the student hears the 
pronunciation of that syllable. However, when the wrong keys are pressed, due to mistaken 
pronunciation or merely due to a keying error, the sounds rq)resented by each of the keys 
pressed are heard in sequence rather than togetiier as a syllable. This serves no instmctional 
purpose as the student does not even hear the actual sound of titjp keys pressed. Also it is quite 
frustratiuQg to repeatedly hear the sound of tiiese mistakes, particularly when it is just a keying 
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error. Once one key has been pressed the user cannot change responses without hearing the 
sound of the error. 

There are some inconsistencies regarding the standard of pronunciation used. This is, 
no doubt, due to the inconsistencies in tlie pronunciation of Canadian English. An example of 
this is the word "new" which is presented in the program as both [nu] and [nyu]. There are also 
inconsistencies in syllabification; the division of syllables is sometimes inaccurate and the same 
word may be broken into syllables in different ways in different lessons. This is extremely 
confusing to the student A standard reference for Canadian pronunciation and syllabification, 
such as the Collins Dictionary of Canadian English, should be adopted to avoid such inconsis- 
tencies. 

In the middle of the program punctuation is introduced. Though it is useful for the 
student to be aware of the position of punctuation in a sentence, ac .essing punctuation in the 
program is very slow. Apparentiy the computer must search each voice file before it can indicate 
a punctuation mart This slows down progress considerably and adds an element of frustration. 

The program is designed for students to work through in sequence, building on 
knowledge gained from previous lessons. Though this format has been shown to be effective, 
the amount of time necessary to work through the program is not always available. It would 
be useful if independent lessons dealing witii specific pronunciation problems, and requiring 
only basic knowledge of the keyboard, were developed. This would allow teachers and students 
the freedom to work on specific areas of difficulty without it being necessary to commit the 
time required to complete the entire program. 

It is generally held that comprehensible input is essential for learning and retention. To 
be of maximum benefit, the input should be just a littie beyond the student's present language 
level. Given this tenet, the Boswell Program is most effective for students at the intermediate 
level or above. Students who are at a lower level will have difficulty understanding the 
vocabulary presented and, therefore, will leam and retain less. To benefit the students at the 
lower level, the program could be modified using a smaller vocabulary pool. 
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Ms. Rawling received her B.A. and B.Ed degrees from the University of Victoria. Her 
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Figure 1: 

The Effect of the Boswell System oq In-house Test Scores 
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TEST REPORT FOLLOW-UP 



This document is a Company response to sections of the report titled 'The Boswell 
Computer System and its Effect on English as a Second Language Acquisition". This 
paper addressee xssuts raised in the "Discussion" section of the Report. 



A number of issues mentioned by the students and included in the Report have been, 
or are being, addressed. 



1. In the Student Evaluation two students felt that their grammar had improved (Page 
6y Paragraph 1). As the Program is not designed to teach granunar any recognition 
of improvement in this aspect of language instruction is a credit to the platform and 
the course materials. 

2. Two students reported that the keyboard was difficult to remember (Page 6, 
Paragraph 3). As on a standard QWERTY keyboard, it is necessary for students to 
leam and remember the positions of the keys. On the Boswell, however, learning 
the key assignments is more than a rote skill. Learning the key positicns is an 
integral part of the System because the student not only sees and hears the sound 
but is able to develop a tactile relationship with and therefore use this sense to 
physically distinguish this sound from similar sounds. 

3. Student-suggested improvements to tiie Program (Page 6, Paragraph 4) include 

• screen diagrams of the points of articulation. 

• varied visuals for increased interest 

• a dictionary. 

• interactive voice. 

These improvements to the Program, are at the plaiming stages and wall be incorpo- 
rated into the software as the resources to do so become available. 

The prototype for the incorporation of interactive voice has been developed. It is 
currentiy being refined and integrated kito the courseware. In addition, work is 
under way to include a graphic representation and comparison of the students 
pronunciation beside the correct pronunciation. 

4. Unclear sound files (Page 6, Paragraph 3): the new voice fiiles are to be recorded 
on high quality digital audio tape (DAT) which consistently produces excellent 
sound. 

5. Programming errors (Page 6, Paragraph 7) which affect voice fiOies, prompts and 
graphics are being eliminated. 

6. The presentation of phonemes (Page 6, Paragraph 8) in isolation: it has been the 
long-standing belief that the presentation of isolated phonemes, particularly conso- 

1 



nants, has been impossible or at least extremely difficult Isolated phonemic 
elem^.nts have therefore not been included in language learning curricula. With the 
Boswell platform this is now possible. User comment on the effectiveness of 
presenting discrete phonemes has been mixed, clearly indicating the need for more 
user testing. 

7. The response of the program to incorrect key presses (Page 6, Paragraph 9) has been 
and continues to be reviewed. There has been both positive and negative feedback 
about a computer response which voices the correct phonemes pressed even though 
the overall key press is incorrect. User feedback will ultimately resolve this issue. 

8. The problems caused by inconsistencies in pronunciation and syllabification (Page 
7, Paragraph 2) are being reduced. 

Pronunciation: The Collins dictionary of Canadian English was incorporated as a 
pronunciation guide later in the testing program. Generally, the program reflects 
mid-North American pronunciation and it will continue to be refined to reflect 
Canadian "standard". 

Syllabification: problems with syllabification are sometimes tied to errors within 
the program, but more frequently are related to the fact that standard syllabification 
(and therefore hyphenation) rules reflect the way language is written and presented 
on the printed page rather than the way it is spoken. The Boswell program generally 
breaks down words into their spoken syllables. However, there are times, based on 
sound educational principles and practice, when this general rule is not followed. 
For example, the word "thinking" is formed from the root word "think" and the 
suffix "-ing". The spoken word is pronounced "thin-king", which conflicts with 
accepted hyphenation rulec which breaks the word down as "think-ing". Learning 
a root word and its accompanying suffixes, however, is an important component of 
any English language program. The benefits gained by the student from learning 
the root and its suffix outweigh, in this instance, the subtle distinction between the 
spoken and written syllabification of the word. For this reason, the word "thinking", 
and others like it, are divided according to written rather than spoken guidelines. 

In cases where the syllabification for the same word has varied within the program, 
corrections have been made so that the word is always broken down in the same 
way. 

9. Independent Lessons: 'The program is designed for students to work through in 
sequence it would be useful if independent lessons dealing with specific pro- 
nunciation problems" were included (Page 7, Paragraph 3). 

The Program which was installed at the testing site was a comprehensive program 
designed to teach students aU the phonemes of the language. It is not difficult to 
develop a program which addresses specific pronunciation problems and does not 



require the user to learn the whole program. This can be done immediately, pending 
resources. 

10. The report states (Page 7, Paragraph 5) that the Boswell Program is most effective 
for students at the intermediate level or above. This is based on learning and 
selection criteria at the test site school and reflects the Boswell Program as it was 
tested. Beginners can and do have a powerful language learning experience. 



STATISTICAL SUMMARY 
VifELC STUDY 



Date: July 13th, 1992 

Entered by: S.L Gray 
Checked by: LR. Allnutt 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 

IN HOUSE TEST' WRITTEN SECTION 




WELC STUDY OF WE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 



IN HOUSE TEST- WRITTEN SECTION 











comm. 






i0m 




















Pre4e9t 
score 


Post test 
score 


Rsw 
change 


Percent 
onange 


Pretest 

score 


Postt$$t 
score 


Rsw 

chanae 


Percent 
change 




92-010 


1 


3/S 


4/5 


1 




1/4 


2/4 


1 






92-012 




5/5 


5/5 


0 




1/4 


3/4 


2 




\ : 


92-014 




4/5 


5/5 


1 




4/4 


4/4 


0 






92-016 1 




5/5 


0/5 


<5> 




3/4 


4/4 


1 






1 

92-01S 1 




3/5 


4/5 


1 




2/4 


4/4 


2 






1 92-020 




3/5 


3/5 


0 




3/4 


2/4 


<1> 






\ 92-022 




3/5 


3/5 






4/4 


V4 


<2> 






\ 92-024 




5/5 


3/5 




1 


3/4 


3/4 


0 






1 92-02$ 




3/5 


4/5 






\ 3/4 


4/4 


1 






92-028 




3/5 


4/5 


1 1 




1 3/4 


2/4 


<1> 






AmUGED TOTALS: 




















UEDiANlNCREA^ 
















STANDARD DEmnON: 



















1 92-011 


37.10 


2/5 


4/5 


2 




3/4 


3/4 


0 




n \ 




25J20 


4/5 


4/5 


0 




3/4 


3/4 


0 




\^ \ 


1 92-015 


39J25 


3/S 


5/5 


2 




2/4 


2/4 


0 






92-017 


3BJ30 


5/5 


4/5 


<1> 




3/4 


2/4 


<1> 






92-019 


33JS5 


5/5 


4/5 


<1> 




0/4 


2/4 


2 




f J 


92-021 


33J25 


3/5 


4/5 


1 




1/4 


3/4 


2 






92-023 


32M 


3/5 


5/5 


2 




2/4 


2/4 


0 






92-02S 


42J30 


4/5 


5/5 


1 




1 3/4 


4/4 


1 




« i 


92-027 


20A5 


2/5 


3/5 


1 




1 2/4 


2/4 


0 






1 92-029 


2425 


3/5 


3/5 


0 




1 


4/4 


0 






AVERAGED TOTJdS: 
















:•:<•>:':•;•:■:•:•>:■: . . 




MEDIAN INCREASE: 




















STANDARD DEVIATION: 























O 2 WELCSTDY,002/Juty13,1992/LfiA 

tRlC IS 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 



Raw Test Res"fts: 

IN HOUSE TEST- WRITTEN SECTION 

















Pr9-t9St 

score 


Post test 
score 


Raw 
change 


Percent 1 
change | 






14 


17 


3 




92-012 




24 


26 


2 




92-014 




27 


26 


<1> 




92-016 




19 


12 


<7> 




92-018 




14 


21 


7 




92-020 




20 


20 


0 




\ 92-022 




20 




1 




1 92-024 




15 


12 


<3> 




\ 92-026 






20 


4 




92-028 




1 16 


IB 


2 




AVERAGED TOTALS: 






MEDIAN INOBEASa 
STANDARD DEWnON: 












92-011 


1 37.10 


1 ^7 


20 


3 




\ 92-013 


\2s20 


I" 


21 


5 


1 


{ 92-015 


I 3925 




24 


6 


1 


1 92-017 


36^0 




21 


4 




\92-Oi9 


1 33M5 


15 


15 


0 




\ 92-021 


1 3325 


9 


IS 


6 




1 92-023 


32M 


19 


23 


4 




1 92-025 


42:30 


23 


27 


4 




1 92-027 


20A5 


17 


22 


1 ^ 




1 92-029 


2425 


21 


16 


1 <5> 




AVERAGED TOTALS: 
UED(ANIHCREASE: 
STANDARD DEmWH: 


l^^iliiift" 



ERIC 



3 

13 



WELC$TDY.002/July 13, 1992/LRA 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 



IN HOUSE TEST - AURAL SECTION 











1 


Pr9-t9St 

score 


Post test 
score 


Raw 
change 


Percent || 
change {| 


Pr$-t9$t 
score 


Post test 
score 


Raw 


Percent 
change 




1 

92-010 1 


1 


6/9 


7/9 


1 




10/10 


8/10 


<2> 




:.:<|-.: j 


1 

92-012 1 


1 ■ 


: 6/9 


8/9 


2 


1 
1 


9/10 


8/10 


<1> 






1 

92-014 ' 




1 8/9 


9/9 


1 


1 


9/10 


9/10 


0 






92-016 




1 6/9 


6/9 


0 




10/10 


9/10 


w -fx, 






9:2-018 




6/9 


C/Q 
W9 


Q 




6/10 


8/10 


2 






92-020 




8/9 


8/9 


Q 




8/10 


8/10 


0 






92-022 




\ 7/9 


8/9 


1 




10/10 


mo 


0 






j 92-024 






6/9 


<1> 




7/10 


8/10 


1 






1 92-026 




1 6/9 


5/9 


<1> 




7/10 


7/10 


0 










1 5/9 


3/9 


\<^ 




9/10 


7/10 


<2> 






AVERAC£D TOTALS: 




















MEDIAN INCREASa 














' ^ ^ 






STANDAFID DEVIATION: 














1 Vs"-^"" '■'•^"''.>- - 







mo 


6/9 


9/9 


S 


1 


10/10 


9/10 


<1> 








2510 


5/9 


7/9 


r 
£ 


1 


7/10 


8/10 


1 






92-01$ 


39SS 


6/9 


8/9 


0 




8/10 


8/10 


0 






92-017 


36^ 


2/9 


4/9 


2 




8/10 


9/10 


1 






92-019 


33M5 


7/9 


7/9 


0 




mo 


8/10 


<2> 






I 92-021 


3315 


6/9 


6/9 


0 




9/10 


8/10 


<1> 




■ £■/ 


1 92-023 


32A0 


6/9 


8/9 


2 




5/10 


9/10 




I 
1 




1 d2-(^5 


42J30 


9/9 


9/9 


0 




9/10 


mo 








1 92-027 


2QAS 


7/9 


8/9 


1 




9/10 


9/10 








1 92-029 


2AJ25 


4/9 


3/9 


<1> 




6/10 


5/10 


I- 






AVERAGED TOTALS: 
























MEDIAN INCREASE: 
























STANDARD DEVUmON: 























4 



WELCSTDY.002/July 13, 1992/LRA 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 



Raw Test Results: 

IN HOUSE TEST -AURAL SECTION 











V -> !" 1: 


„ . . . m 












Pn4a$i 
score 


Post test 
score 


flaw 

chattae 


Percent 
change 


Pre-tast 
score 


Post test 
score 


,1 


It 




ir~ — 1 

g 92-010 




1 

1 itoo/is 


12J)0n5 


1,00 


1 
1 


tut; 


UrQ 


<2> 






r= n 

1 92-012 \ 




10^5 


ii^sns 


1,00 


1 


Wo 


OrO 


1 






1 1 

1 92-014 t 




mm 


13£0n5 


,50 




Alti 


A V 


1 






92-016 




9^15 


9,00/15 


<25> 


1 

1 




•Ir w 


1 






92-018 




mm 








*ww 


6/6 


2 






1 92-020 




11,75ns 


mons 


1,25 




5/6 


6/6 


1 










1825ns 


i4,oons 


i - 




6/6 


6/6 


0 






i 92-024 




1 9,75/15 


lojms 






5/6 


6/6 


1 










1 9,m5 


lojoons 






4/6 


6/6 


2 




Iff] \ 


1 92-028 




1 8,50/,^ 


io,oons 






5/$ 


4/6 


<1> 






AVERAGED TOTALS: 


















UEDIAN INCREASE: 




















STANDARD DEVIATION: 





















|o2-0ff 


37,10 


mons 


i8,7sns 


325 




5/6 


5/6 


0 






1 $2-013 


2520 


io2sns 


i2,oons 


1,75 




3/6 


5/6 


2 




1 92-0t5 


8925 


1225ns 


12,75ns 


,50 




5/6 


6/6 


1 




1 92-017 


36,30 


8,oons 


9,75/15 


1,75 




416 


4/6 


0 






1 92-0f9 


33,55 


8,5ons 


io,oons 


1,50 




1/6 


4/6 


8 




11 92-021 


3325 


6,oons 


925ns 


825 




2/6 


3/6 


1 






D 92-029 


32A0 


i22sns 


i8,7sns 


1,50 




5/6 


6/6 


1- 




ir«2^5 


I 4Z30 


1125ns 


12J50nS 


125 




4/6 


6/6 


u 




fl 92-027 


20 AS 


9,oons 


12,00nS \ 8,00 




3/6 


5/6 


1 2 




H 92-029 II 


925ns 


iijsons 


I 225 




4/6 


1 5/6 


1 1 






AyBiAGED TOTALS: 
MEDfAN INCREASE: 
STANDARD DEVIAVON: 

















er|c 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 

IN HOUSE TEST- AURAL SECTION 











scon 


P0Stt9St 

scon 


chMngs 




If 

H 92-010 


1 


32M0 


30.00 


<zoo> 


1 


P 92-012 




27J2S 


302S 


3.00 


1 


92-014 




UJOO 


36J50 


2^0 


_ 


j 92-016 




28S5 


28J}0 


<025> 




1 92-018 




26J50 


3125 


4.75 




1 92-020 




32.75 


3525 


225 




1 92-022 




36^ 


38.00 ! t75 




1 92-024 




28s7S 


30,00 1 125 




1 92-026 




26M0 


28.00 1 ZOO 




1 ^2-023 




Z7JS0 


24J00 1 ^J50> 




AVERAGED TOTVUA ||^^^ 
yB>UU4 INCREASE: fe^M 
STANDARD DErnnON: |[^^^ 


:;^>.;f.j.:«'K':'y«v:':'X': 



92-011 


37.10 


31.50 


36.75 


5.25 




92-013 


2520 


2525 


32.00 


6.75 




\ 92-015 


3925 


3325 


34.75 


1.50 




92-017 


36.30 


22M 


26J5 


4.75 




P 92-019 




\ 26.50 


29.00 


2J50 




1 92-021 


3325 


23M 


2625 


325 




i 92-023 


32A0 


2825 


36.75 


8.50 




1 92-025 


42.30 


3325 


37JS0 


4.25 




1 92-027 


20A5 


28J00 


34J00 


6.00 




li 92-029 


\ 2425 


2325 


24J50 


125 


• 


AVERAGED TOTALS: 
MEDIAN INCREASE: 
STANDARD DEVIATION: 


^^^^^^ 



WELCSTDY.002/JuJy 13, 1992/LRA 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 



BASIC ENGLISH SKILLS TEST (BEST) ■ WRITTEN SECTION 




WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 



Raw Test Results: 

BASIC ENGLISH SKILLS TEST (BESV ■ WRITTEN SECTION 

















scort 1 


it 

14. O 


p9rcent 
chBng9 


92-010 I 


ir 

62 


S3 


f 




92-012 1 


1 


53 


64 


ft 




92-014 


.1 


V 


71 


<6> 


1 
1 


92-016 




46 


44 


<2> 


=— 


92-018 


1 


66 


6$ 


<$> 




92-020 


1 


65 


69 


4 




92-022 


1 


76 


74 


<2> 




1 92-024 


1 


1 

1 45 


48 


I. 




[ 92-026 


II i» 


61 






1 92-028 


1 




6$ 






AVERAGED TCXTAIS: 










UEDiAN INCREASE: 








STANDARD DEmnON: 









92-011 \ 


37.10 1 


59 


52 


3 


1 


92-013 1 


25^0 1 


54 


60 


6 


1 


$2-015 


39^5 ' 


77 


69 


<9> 




92-017 




62 


60 


<2> 




1 92-019 


33^ 


34 


33 


<f> 




1 92-021 


33^ 


45 


50 


5 




1 92-023 


32A0 


1 73 


53 


1 <5> 




1 92-<^5 


42J30 




70 






1 92-027 


I 20^ 




72 






92-029 


1 24:25 


57 


60 






AVERAGED TOTALS: 
UEDtAN INCREASE: 
STANDARD DEVUmON: 




^^^^^^^^^^ 



^ g WELCSTDYM02/July13,1992n.RA 

ERIC 24 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 



BASIC ENGLISH SKILLS TEST (BEST) ■■ ORAL SECTION (Interview) 





















$G0r9 


P0Stt9$t 

score 


change 


cbiiige 


scoff 


Post t9$t 
$C0f9 


Raw 


Percent 




92'O10 




8 


6 


<2> 




35 


40 


5 






1 92-012 




5 


7 


2 






27 


<2> 






1 92-014 






9 


2 




40 


4$ 


6 





1 92-016 




4 


9 


$ 




21 


36 


15 




\ 


1 92-018 




6 


9 


3 




rrr 


31 


<$> 






1 92-<f20 




8 


, 






39 


41 


2 




^■ 


1 92-m 




S 


9 


- 




44 


46 


2 




! i ^ 

id'; 


92-024 




4 


3 


I- 




u 


28 


4 




92-026 




6 


8 






33 


34 


1 






92-028 


1 
1 


3 


$ 


1 ^ 






27 


$ 






AVERAGED TOTALS: 
















MEDtANlNCREA^ 
STANDARD DEVtAVON: 




















UEDmOKREASE: 
STAHOMDDEmHOH: 



ERIC 



25 



WELCSTDY.002/Juty 13, 1992AMA 



WELC STUDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 

BASIC ENGLISH SKILLS TEST (BEST) - ORAL SECTION (Interview) 





92-010 



92-012 



92-01^ 



92-Ois 



92-018 



92-020 



92-022 



92-024 



92-026 



scon 



92-028 



15 



P09tt9$t 

scor9 



17 



fljw 
eh$ng9 



11 
23 



18 



15 



13 
20 



P9rc$nt 
Changs 



<3> 



20 



20 



<11> 



22 



21 



14 



11 



21 



13 



10 



19 



14 



AVERAGED TOTALS: 
UEDtAN INCREASE: 
STANDARD DErnnON: 



1 



[ 92-^11 


37.10 


6 


23 


17 




1 92-013 


2520 


15 


20 


5 




1 $2-015 


39SS 


22 


24 


2 




1 92-017 


36J30 


15 


22 


7 




92'C19 


33J55 


1 


10 


9 




1 92-C21 


1 33^ 


\ 0 


17 


17 




1 $2-023 


1 32A0 


1 20 


10 


<10> 




1 $2-C2S 


1 42J30 


1 13 


16 


3 




fl 92-027 


1 2045 


1" 


19 


0 




H $2-029 


1 2425 


I" 


20 


10 




AVERAGED TOTUS: 
UEDUkHIHCREASE: 




[^^^^ 





STANDARD DEWmOH: 

er|c 



10 



2o 



WELCSTDY.002/Jufy 13, m2/LRA 



WELC S'l UDY OF THE BOSWELL ESL PROGRAM - LEVEL I 

Raw Test Results: 

BASIC ENGLISH SKILLS TEST (BEST) - ORAL SECTION (Interview) 





BOmB:tr. 












scon 


Po$tM 
scon 


Haw 
chsngs 




92-010 




58 


63 


5 




92-012 




« ! 


47 


2 




92-014 




70 


75 


5 




92^16 




25 


65 


40 




92-018 




$1 


47 


<14> 




92-020 






72 


10 




92-022 




\70 


76 


6 




92-024 




1 31 


1 

^ 1 


13 




92^2$ 






« 1 


8 




92^28 


1 


35 


47 ' 


12 




A)fERAGEDrOTAlS: 












MEDIAN IHCREASa 












STANDARD DevymON: 




















92-C11 


$7,10 


34 


72 


3$ 




92-013 


2520 


59 


68 


10 




92-01$ 


1 392S 


$8 


72 


4 


1 


92-017 


\3SJiO 


67 


76 


9 




92-019 


1 

1 33^ 


18 


S3 


35 




92-021 


332S 


26 


9* 


36 




92-023 


32A0 


$4 


62 


u 


1 




42M 


56 

1 


63 


1 ' 


1 


92-027 


20A5 




68 


1 <1> 




92-029 


2425 




6$ 


1 ^ 




AyERAGED TOTALS: 












MEDIAN IHCREASE 












STANDARD DBVIATJON: 










^^<•:<^x■^^•x^•^:w:^■:'.-x•: 



ERIC 



WELCSrDY.002/July13, 1992/LRA 



